Multi-dimensional Feature Fusion Research Articles

SRTRP-Net: A multi-task learning network for segmentation and prediction of stereotactic radiosurgery treatment response in brain metastases

Before the Stereotactic Radiosurgery (SRS) treatment, it is of great clinical significance to avoid secondary genetic damage and guide the personalized treatment plans for patients with brain metastases (BM) by predicting the response to SRS treatment of brain metastatic lesions. Thus, we developed a multi-task learning model termed SRTRP-Net to provide prior knowledge of BM ROI and predict the SRS treatment response of the lesion. In dual-encoder tumor segmentation Network (DTS-Net), two parallel encoders encode the original and mirrored multi-modal MRI images. The differences in the dual-encoder features between foreground and background are enhanced by the symmetrical visual difference block (SVDB). In the bottom layer of the encoder, a transformer is used to extract local contextual features in the spatial and depth dimensions of low-resolution images. Then, the decoder of DTS-Net provides the prior knowledge for predicting the response to SRS treatment by performing BM segmentation. SRS response prediction network (SRP-Net) directly utilizes shared multi-modal MRI features weighted by the signed distance map (SDM) of the masks. The bidirectional multi-dimensional feature fusion module (BMDF) fuses the shared features and the clinical text information features to obtain comprehensive tumor information for characterizing tumors and predicting SRS treatment response. Experiments based on internal and external clinical datasets have shown that SRTRP-Net achieves comparable or better results. We believe that SRTRP-Net can help clinicians accurately develop personalized first-time treatment regimens for BM patients and improve their survival.

Enhancing non-intrusive load monitoring with weather and calendar feature integration in DAE

The construction of modern power system is key to achieving dual carbon goals, where non-intrusive load monitoring (NILM) plays a vital role in enhancing energy utilization efficiency and energy management. For example, to enable prosumers to better understand the extent of their flexible loads for demand response and peer-to-peer trading, it is essential to be aware of the types and states of loads using the method of NILM. To improve the predictive accuracy and implementation effectiveness of NILM technology, this paper proposes a novel NILM method integrating meteorological and calendar features. It delves deeply into the close connection between external factors such as temperature, precipitation, wind speed, and holidays, and the energy consumption of electrical appliances, constructing additional associative mappings in the training of the Denoising Autoencoder (DAE) model. Test results on the UK-DALE public dataset show that the NILM method proposed in this paper has significant advantages over traditional NILM methods that consider only single-dimensional electrical data features, in terms of load pattern recognition and accuracy in load energy consumption monitoring. This confirms the potential of multi-dimensional feature fusion technology in the application of NILM.

A Multi-Dimensional Feature Fusion Recognition Method for Space Infrared Dim Targets Based on Fuzzy Comprehensive with Spatio-Temporal Correlation

Space infrared (IR) target recognition has always been a key issue in the field of space technology. The imaging distance is long, the target is weak, and the feature discrimination is low, making it difficult to distinguish between high-threat targets and decoys. However, most existing methods ignore the fuzziness of multi-dimensional features, and their performance mainly depends on the accuracy of feature extraction, with certain limitations in handling uncertainty and noise. This article proposes a space IR dim target fusion recognition method, which is based on fuzzy comprehensive of spatio-temporal correlation. First, we obtained multi-dimensional IR features of the target through multi-time and multi-spectral detectors, then we established and calculated the adaptive fuzzy-membership function of the features. Next, we applied the entropy weight method to ascertain the objective fusion weights of each feature and computed the spatially fuzzified fusion judgments for the targets. Finally, the fuzzy comprehensive function was used to perform temporal recursive judgment, and the ultimate fusion recognition result was obtained by integrating the results of each temporal recursive judgment. The simulation and comparative experimental results indicate that the proposed method improved the accuracy and robustness of IR dim target recognition in complex environments. Under ideal conditions, it can achieve an accuracy of 88.0% and a recall of 97.5% for the real target. In addition, this article also analyzes the impact of fusion feature combinations, fusion frame counts, different feature extraction errors, and feature database size on recognition performance. The research in this article can enable space-based IR detection systems to make more accurate and stable decisions, promoting defense capabilities and ensuring space security.

Ultra-short-term forecasting model of power load based on fusion of power spectral density and Morlet wavelet.

An accurate ultra-short-term time series prediction of a power load is an important guarantee for power dispatching and the safe operation of power systems. Problems of the current ultra-short-term time series prediction algorithms include low prediction accuracy, difficulty capturing the local mutation features, poor stability, and others. From the perspective of series decomposition, a multi-scale sequence decomposition model (TFDNet) based on power spectral density and the Morlet wavelet transform is proposed that combines the multidimensional correlation feature fusion strategy in the time and frequency domains. By introducing the time-frequency energy selection module, the "prior knowledge" guidance module, and the sequence denoising decomposition module, the model not only effectively delineates the global trend and local seasonal features, completes the in-depth information mining of the smooth trend and fluctuating seasonal features, but more importantly, realizes the accurate capture of the local mutation seasonal features. Finally, on the premise of improving the forecasting accuracy, single-point load forecasting and quantile probabilistic load forecasting for ultra-short-term load forecasting are realized. Through the experiments conducted on three public datasets and one private dataset, the TFDNet model reduces the mean square error (MSE) and mean absolute error (MAE) by 19.80 and 11.20% on average, respectively, as compared with the benchmark method. These results indicate the potential applications of the TFDNet model.

Research on educational applications based on diagnostic learning analytics in the context of big data analytics

Abstract In the context of the significant data era, this paper explores the educational applications based on diagnostic learning analytics technology to improve personalized learning and teaching effects in the educational process. The study adopts a multidimensional feature fusion approach to construct a cognitive diagnostic model to predict learners’ knowledge status and future learning performance. Through actual data testing, the model can effectively predict the students’ knowledge mastery state and analyze the students’ learning process in depth. The experimental results show that the diagnostic model exhibits high efficiency and accuracy in predicting students’ knowledge mastery status, with an accuracy rate of 92.97%, significantly better than traditional teaching methods. In addition, the study explores the encoding method of learners’ multidimensional features and constructs a dynamic diagnostic model of test factors and student factors based on graph attention network. The study provides a new learning analysis and diagnostic method in the education field, which helps improve the effect of personalized learning.

CSF-GTNet: A Novel Multi-Dimensional Feature Fusion Network Based on Convnext-GeLU- BiLSTM for EEG-Signals-Enabled Fatigue Driving Detection.

Electroencephalography (EEG) signal has been recognized as an effective fatigue detection method, which can intuitively reflect the drivers' mental state. However, the research on multi-dimensional features in existing work could be much better. The instability and complexity of EEG signals will increase the difficulty of extracting data features. More importantly, most current work only treats deep learning models as classifiers. They ignored the features of different subjects learned by the model. Aiming at the above problems, this paper proposes a novel multi-dimensional feature fusion network, CSF-GTNet, based on time and space-frequency domains for fatigue detection. Specifically, it comprises Gaussian Time Domain Network (GTNet) and Pure Convolutional Spatial Frequency Domain Network (CSFNet). The experimental results show that the proposed method effectively distinguishes between alert and fatigue states. The accuracy rates are 85.16% and 81.48% on the self-made and SEED-VIG datasets, respectively, which are higher than the state-of-the-art methods. Moreover, we analyze the contribution of each brain region for fatigue detection through the brain topology map. In addition, we explore the changing trend of each frequency band and the significance between different subjects in the alert state and fatigue state through the heat map. Our research can provide new ideas in brain fatigue research and play a specific role in promoting the development of this field.

Stress Classification Using ECGs Based on a Multi-Dimensional Feature Fusion of LSTM and Xception

Stress Classification Using ECGs Based on a Multi-Dimensional Feature Fusion of LSTM and Xception

Single-Stage Pose Estimation and Joint Angle Extraction Method for Moving Human Body

Detecting posture changes of athletes in sports is an important task in teaching and training competitions, but its detection remains challenging due to the diversity and complexity of sports postures. This paper introduces a single-stage pose estimation algorithm named yolov8-sp. This algorithm enhances the original yolov8 architecture by incorporating the concept of multi-dimensional feature fusion and the attention mechanism for automatically capturing feature importance. Furthermore, in this paper, angle extraction is conducted for three crucial motion joints in the motion scene, with polynomial corrections applied across successive frames. In comparison with the baseline yolov8, the improved model significantly outperforms it in AP50 (average precision) aspects. Specifically, the model’s performance improves from 84.5 AP to 87.1 AP, and the performance of AP50–95, APM, and APL aspects also shows varying degrees of improvement; the joint angle detection accuracy under different sports scenarios is tested, and the overall accuracy is improved from 73.2% to 89.0%, which proves the feasibility of the method for posture estimation of the human body in sports and provides a reliable tool for the analysis of athletes’ joint angles.

Establishment and application of TSDPSO-SVM model combined with multi-dimensional feature fusion method in the identification of fracture-related infection

Fracture-related infection (FRI) is one of the most common and intractable complications in orthopedic trauma surgery. This complication can impose severe psychological burdens and socio-economic impacts on patients. Although the definition of FRI has been proposed recently by an expert group, the diagnostic criteria for FRI are not yet standardized. A total of 4761 FRI patients and 4761 fracture patients (Non-FRI) were included in the study. The feature set of patients included imaging characteristics, demographic information, clinical symptoms, microbiological findings, and serum inflammatory markers, which were reduced by the Principal Component Analysis. To optimize the Support Vector Machine (SVM) model, the Traction Switching Delay Particle Swarm Optimization (TSDPSO) algorithm, a recognition method was proposed. Moreover, five machine learning models, including TSDPSO-SVM, were employed to distinguish FRI from Non-FRI. The Area under the Curve of TSDPSO-SVM was 0.91, at least 5% higher than that of other models. Compared with the Random Forest, Backpropagation Neural Network (BP), SVM and eXtreme Gradient Boosting (XGBoost), TSDPSO-SVM demonstrated remarkable accuracy in the test set (chi^{ 2} = 29.17, ,50.46, ,56.66,,35.88, P < 0.01). The recall of TSDPSO-SVM was 98.32%, indicating a significant improvement (chi^{2} = 91.78,, 107.42, ,135.69, P < 0.01). Compared with BP and SVM, TSDPSO-SVM exhibited significantly superior specificity, false positive rate and precision (chi^{2} > 3.84, P < 0.05). The five models yielded consistent results in the training and testing of FRI patients across different age groups. TSDPSO-SVM is validated to have the maximum overall prediction ability and can effectively distinguish between FRI and Non-FRI. For the early diagnosis of FRI, TSDPSO-SVM may provide a reference basis for clinicians, especially those with insufficient experience. These results also lay a foundation for the intelligent diagnosis of FRI. Furthermore, these findings exhibit the application potential of this model in the diagnosis and classification of other diseases.

Research on Fault Detection for Microservices Based on Log Information and Social Network Mechanism Using BiLSTM-DCNN Model

The microservice architecture breaks through the traditional cluster architecture mode based on virtual machines and uses containers as carriers to interact through lightweight communication mechanisms to reduce system coupling and provide more flexible system service support. With the expansion of the system scale, a large number of system logs with complex structures and chaotic relationships are generated. How to accurately analyze the system logs and make efficient fault prediction is particularly important for building a safe and reliable system. By studying neural network technology, this paper proposes an Attention-Based Bidirectional Long Short-Term Memory Network (Bi-LSTM). Combined with the dual channel convolutional neural network model (DCNN), it uses the attention mechanism to explore the differences between dimensional features, realizes multi-dimensional feature fusion, and establishes a BiLSTM-DCNN deep learning model that integrates the attention mechanism. From the perspective of social network analysis, a data preprocessing method is proposed to process fault redundant data and improve the accuracy of fault prediction under Microservices. Compare BiLSTM-DCNN with the mainstream system log analysis machine learning models SVM, CNN and Bi-LSTM, and explore the advantages of BiLSTM-DCNN in processing microservice system log text. The model is applied to simulation data and HDFS data set for experimental comparison, which proves the good generalization ability and universality of BiLSTM-DCNN.

A multidimensional feature fusion network based on MGSE and TAAC for video-based human action recognition

With the maturity of intelligent technology such as human-computer interaction, human action recognition (HAR) technology has been widely used in virtual reality, video surveillance, and other fields. However, the current video-based HAR methods still cannot fully extract abstract action features, and there is still a lack of action collection and recognition for special personnel such as prisoners and elderly people living alone. To solve the above problems, this paper proposes a multidimensional feature fusion network, called P-MTSC3D, a parallel network based on context modeling and temporal adaptive attention module. It consists of three branches. The first branch serves as the basic network branch, which extracts basic feature information. The second branch consists of a feature pre-extraction layer and two multiscale-convolution-based global context modeling combined squeeze and excitation (MGSE) modules, which can extract spatial and channel features. The third branch consists of two temporal adaptive attention units based on convolution (TAAC) to extract temporal dimension features. In order to verify the validity of the proposed network, this paper conducts experiments on the University of Central Florida (UCF) 101 dataset and the human motion database (HMDB) 51 dataset. The recognition accuracy of the proposed P-MTSC3D network is 97.92% on the UCF101 dataset and 75.59% on the HMDB51 dataset, respectively. The FLOPs of the P-MTSC3D network is 30.85G, and the test time is 2.83 s/16 samples on the UCF101 dataset. The experimental results demonstrate that the P-MTSC3D network has better overall performance than the state-of-the-art networks. In addition, a prison action (PA) dataset is constructed in this paper to verify the application effect of the proposed network in actual scenarios.

Pattern recognition of schizophrenia based on multidimensional spatial feature fusion

Pattern recognition of schizophrenia based on multidimensional spatial feature fusion

Research on Material Demand Forecasting Algorithm Based on Multi-Dimensional Feature Fusion

Material demand forecasting has a profound impact on the supply chain and is an important prerequisite for manufacturing enterprises to produce. In order to accurately predict the material demand of enterprises, this paper proposes a material demand forecasting algorithm based on multi-dimensional feature fusion (DFMF). Secondly, in order to obtain the spatial features, the vector representation of the relevant materials of a material is obtained through the attention mechanism. Then, the authors aggregate the relevant material representation and material vector representation of materials to obtain the final material vector representation through aggregation function. Then the final material vector representation under different time scales is used as input, and the prediction value of material demand is obtained by using BP neural network. Finally, experiments show that the model can effectively obtain multi-dimensional features of materials for prediction, and the prediction results have high accuracy.

Gas Sensor Array Fault Diagnosis Based on Multi-Dimensional Fusion, an Attention Mechanism, and Multi-Task Learning.

With the development of gas sensor arrays and computational technology, machine olfactory systems have been widely used in environmental monitoring, medical diagnosis, and other fields. The reliable and stable operation of gas sensing systems depends heavily on the accuracy of the sensors outputs. Therefore, the realization of accurate gas sensor array fault diagnosis is essential to monitor the working status of sensor arrays and ensure the normal operation of the whole system. The existing methods extract features from a single dimension and require the separate training of models for multiple diagnosis tasks, which limits diagnostic accuracy and efficiency. To address these limitations, for this study, a novel fault diagnosis network based on multi-dimensional feature fusion, an attention mechanism, and multi-task learning, MAM-Net, was developed and applied to gas sensor arrays. First, feature fusion models were applied to extract deep and comprehensive features from the original data in multiple dimensions. A residual network equipped with convolutional block attention modules and a Bi-LSTM network were designed for two-dimensional and one-dimensional signals to capture spatial and temporal features simultaneously. Subsequently, a concatenation layer was constructed using feature stitching to integrate the fault details of different dimensions and avoid ignoring useful information. Finally, a multi-task learning module was designed for the parallel learning of the sensor fault diagnosis to effectively improve the diagnosis capability. The experimental results derived from using the proposed framework on gas sensor datasets across different amounts of data, balanced and unbalanced datasets, and different experimental settings show that the proposed framework outperforms the other available methods and demonstrates good recognition accuracy and robustness.

Student engagement detection in online environment using computer vision and multi-dimensional feature fusion

Student engagement detection in online environment using computer vision and multi-dimensional feature fusion

MDFF-Net: A multi-dimensional feature fusion network for breast histopathology image classification

Breast cancer is a common malignancy and early detection and treatment of it is crucial. Computer-aided diagnosis (CAD) based on deep learning has significantly advanced medical diagnostics, enhancing accuracy and efficiency in recent years. Despite the convenience, this technology also has certain limitations. When the morphological characteristics of the patient’s pathological section are not evident or complex, certain small lesions or cells deep within the lesion cannot be recognized, and misdiagnosis is prone to occur. As a result, MDFF-Net, a CNN-based multidimensional feature fusion network, is proposed. The model consists of a one-dimensional feature extraction network, a two-dimensional feature extraction network, and a feature fusion classification network. The basic part of the two-dimensional feature extraction network is stacked by modules integrated with multi-scale channel shuffling networks and channel attention modules. Furthermore, inspired by natural language processing, this model integrates a one-dimensional feature extraction network to extract detailed information in the image to avoid misdiagnosis caused by insufficient information extraction such as cell morphological characteristics and differentiation degree. Finally, the extracted one-dimensional and two-dimensional features are fused in the feature fusion network and employed for the final classification. The effectiveness of MDFF-Net and classical classification models were evaluated on the BreakHis and the BACH datasets. According to experimental results, MDFF-Net achieves an accuracy of 98.86% on the BreakHis and 86.25% on the BACH dataset. Furthermore, to further assess the effectiveness of the model in other classification tasks, the colon cancer and the lung cancer datasets were employed for additional experiments, achieving a classification accuracy of 100% in both cases.

Classification of Camellia oleifera Diseases in Complex Environments by Attention and Multi-Dimensional Feature Fusion Neural Network.

The use of neural networks for plant disease identification is a hot topic of current research. However, unlike the classification of ordinary objects, the features of plant diseases frequently vary, resulting in substantial intra-class variation; in addition, the complex environmental noise makes it more challenging for the model to categorize the diseases. In this paper, an attention and multidimensional feature fusion neural network (AMDFNet) is proposed for Camellia oleifera disease classification network based on multidimensional feature fusion and attentional mechanism, which improves the classification ability of the model by fusing features to each layer of the Inception structure and enhancing the fused features with attentional enhancement. The model was compared with the classical convolutional neural networks GoogLeNet, Inception V3, ResNet50, and DenseNet121 and the latest disease image classification network DICNN in a self-built camellia disease dataset. The experimental results show that the recognition accuracy of the new model reaches 86.78% under the same experimental conditions, which is 2.3% higher than that of GoogLeNet with a simple Inception structure, and the number of parameters is reduced to one-fourth compared to large models such as ResNet50. The method proposed in this paper can be run on mobile with higher identification accuracy and a smaller model parameter number.

Application of IoT detection based on deep self coding multidimensional feature fusion in sports training

In response to the shortcomings of existing centralized IoT detection activities, this article proposes a new IoT detection scheme based on programmable switches and deep self coding, which combines programmable switches with IoT MQTT protocol and multidimensional feature fusion algorithm. Based on this point, a comprehensive programmable switch and machine learning centralized IoT detection system are designed. This system is different from traditional centralized IoT detection systems. The IoT detection module discussed in this article is located on a programmable switch between IoT nodes and servers. This system utilizes the potential of programmable switches to quickly collect required information from packet data and pre detect fault data from the front end of the server, thereby quickly making IoT node packet processing decisions (i.e. redirecting or directly discarding) based on programmable switches to minimize the delay in transmitting data packets. Finally, in order to apply this technology to the field of sports training, we examined different directions of sports training. Therefore, based on the development of simulation systems, this article greatly enhances the practicality of such projects, effectively increasing the usage time and meeting the actual training needs. Therefore, The deep self coding computer simulation of sports training is an issue that we must pay attention to. The article conducted research on IoT detection based on deep self coding multidimensional feature fusion, and applied the research results to sports training, promoting the rapid development of sports training.

A journal name semantic augmented multi-dimensional feature fusion model for scholarly journal recommendation

Recommending appropriate academic journal to researchers has become a time-consuming and challenging task. In this paper, we propose a Journal Name Semantic-enhanced Multidimensional Feature Fusion Journal Recommendation (JNSMFFJRec) model that both integrates journal name semantic information and capture deep semantic information. The model is the first of its kind to fuse multi-dimensional feature based on BERT layer and tow-tower layer, that only requires the abstract and the title of a manuscript to identify academic journal. Compared to advanced benchmark models, the experiments based on the real dataset Information System and Management (ISaM) of Scopus show that the performance of the proposed academic journal recommendation model outperforms. Specifically, the Mean Average Precision improved by 1.34%-19.42%; the Mean Reciprocal Rank improved by 3.56%-59.79%; the TOP-5 Recall improved by 1.72%-43.94%; and the result Diversity improved by 2.4%-18.6%.

Application of UAV RGB Images and Improved PSPNet Network to the Identification of Wheat Lodging Areas

As one of the main disasters that limit the formation of wheat yield and affect the quality of wheat, lodging poses a great threat to safety production. Therefore, an improved PSPNet (Pyramid Scene Parsing Network) integrating the Normalization-based Attention Module (NAM) (NAM-PSPNet) was applied to the high-definition UAV RGB images of wheat lodging areas at the grain-filling stage and maturity stage with the height of 20 m and 40 m. First, based on the PSPNet network, the lightweight neural network MobileNetV2 was used to replace ResNet as the feature extraction backbone network. The deep separable convolution was used to replace the standard convolution to reduce the amount of model parameters and calculations and then improve the extraction speed. Secondly, the pyramid pool structure of multi-dimensional feature fusion was constructed to obtain more detailed features of UAV images and improve accuracy. Then, the extracted feature map was processed by the NAM to identify the less significant features and compress the model to reduce the calculation. The U-Net, SegNet and DeepLabv3+ were selected as the comparison models. The results show that the extraction effect at the height of 20 m and the maturity stage is the best. For the NAM-PSPNet, the MPA (Mean Pixel Accuracy), MIoU (Mean Intersection over Union), Precision, Accuracy and Recall is, respectively, 89.32%, 89.32%, 94.95%, 94.30% and 95.43% which are significantly better than the comparison models. It is concluded that NAM-PSPNet has better extraction performance for wheat lodging areas which can provide the decisionmaking basis for severity estimation, yield loss assessment, agricultural operation, etc.